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Abstract 

The problem of transmitting an i.i.d Gaussian source over an i.i.d Gaussian wiretap channel with an i.i.d 
Gaussian side information is considered. The intended receiver is assumed to have a certain minimum SNR and the 
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eavesdropper is assumed to have a strictly lower SNR compared to the intended receiver. The objective is minimizing 



the distortion of source reconstruction at the intended receiver. It is shown, in this work, that unlike the Gaussian 
wiretap channel without side information, Shannon's source-channel separation coding scheme is not optimum in the 
, sense of achieving the minimum distortion. Three hybrid digital-analog secure joint source channel coding schemes 

' are then proposed which achieve the minimum distortion. The first coding scheme is based on Costa's dirty paper 

coding scheme and wiretap channel coding scheme when the analog source is not explicitly quantized. The second 
coding scheme is based on superposition of the secure digital signal and the hybrid digital-analog signal. It is shown 
that for the problem of communicating a Gaussian source over a Gaussian wiretap channel with side information, 
there exists an infinite family of optimum secure joint source-channel coding scheme. In the third coding scheme, 
the quantized signal and the analog error signal are explicitly superimposed. It is shown that this scheme provide an 
infinite family of optimum secure joint source-channel channel coding schemes with a variable number of binning. 
Finally, the proposed secure hybrid digital-analog schemes are analyzed under the main channel SNR mismatch. It 
■ is proven that the proposed schemes can give a graceful degradation of distortion with SNR under SNR mismatch, 

CO , i.e., when the actual SNR is larger than the designed SNR. 
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I. Introduction 

Security protocols are the most critical elements involved in enabling the growth of the wide range of wireless 
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O data networks and applications. The broadcast nature of wireless communications, however, makes them particularly 
1 ■ vulnerable to eavesdropping. With the proliferation of more complex modern infrastructure systems, there is an in- 
, creasing need for secure communication solutions. Cryptography is a traditional field that provides computationally- 
k>( \ secure protocols at the application layer. The goal of cryptography has recently been diversified from providing 
5_j ■ the critical confidentiality service, to other issues including authentication, key exchange and management, digital 
signature, and more. Unlike the cryptographic approaches, the recently reintroduced physical-layer security aims 
to develop effective secure communication schemes exploiting the properties of the physical layer. This new 
paradigm can strength the security of existing systems by introducing a level of information-theoretic security 
which has provable security, as compared with computational security. The notion of information theoretic secrecy 
in communication systems was first introduced in |1]. The information theoretic secrecy requires that the received 
signal by an eavesdropper not provide any information about the transmitted messages. Following the pioneering 
works of |2] and |3] which studied the wiretap channel, many extensions of wiretap channel model have been 
considered from a perfect secrecy point of view (see e.g., |4ll-i8ll). 

In |9), iflQl . the Gaussian wiretap channel of ifTTI is extended to the Gaussian wiretap channel with side 
information available at the transmitter. In the Gaussian wiretap channel with side information, an i.i.d additive white 
Gaussian interference is added to the transmitted signal. The interference is completely known at the transmitter 
an can be used as a covert communication channel. References ifTull have proposed an achievable perfect 
secrecy rate for the Gaussian wiretap channel with side information. The achievable coding scheme of |9), IflQl is 
a combination of the Costa's dirty-paper-coding [12] and the wiretap channel coding, and the source is assumed 
to be digital. We refer to this coding scheme as Digital-Secret Dirty-Paper-Coding (DS-DPC) scheme. 

All extensions of wiretap channel model have considered communicating a discrete source with perfect secrecy 
constraint. In many applications, however, a bandlimited analog source need to be transmitted on a bandlimited 



Gaussian wiretap channel with side information. In many situations, the exact signal-to-noise ratio (SNR) of the 
main channel may not be known at the transmitter. Usually, a range of the main channel SNR is known but the 
true SNR value is unknown. Given a range of main channel SNR such that the eavesdropper's signal is degraded 
with respect to the legitimate receiver's signal, it is desirable to design a single transmitter which has a robust 
performance for all range of SNRs. A common method of designing such a system is based on Shannon's source- 
channel separation coding: Quantize the analog source and then transmit the result discrete source by the digital 
secret dirty paper coding scheme. The main advantage of a digital system is that it is more reliable an cost efficient. 

The inherent problem of digital systems is that they suffer from a severe form of "threshold effect" lfl"3ll , lPT4l . 
This effect can briefly described as follows: The system achieves a certain performance at a certain designed SNR. 
When the SNR is increased, the system performance, however, does not improved and it degrades drastically when 
the true SNR falls below the designed SNR. The severity of the threshold effect in digital systems is related to 
Shannon's source-channel separation principle ITT31 . Recent works on non-secure communication systems, however, 
proved that joint source-channel coding schemes not only can outperform the digital systems for a fixed complexity 
and delay, they are also more robust against the SNR variations ifToll - EOll . 

In |fl"8ll , several hybrid digital-analog joint source channel coding scheme is proposed for transmitting a Gaussian 
source over a (non-secure) Gaussian channel (without side information). The main idea in |[T8l to increase robustness 
is to reduce the number of quantization intervals, and thereby increase the distance between the decision lines of the 
quantization levels. This will, however, increase the distortion. Therefore, to compensate the coarser representation, 
the quantization error is sent as an analog symbol using a linear coder (see also [21]). In E2l . different coding 
schemes is analyzed for transmitting a Gaussian source over a Gaussian wiretap channel (without side information). 
For a fixed information leakage rate to the eavesdropper, 1221 has showed that superimposing the secure digital 
signal with the analog (quantization error) part has better performance compared to the separation based scheme 
and the uncoded scheme. In ll23l . the problem of transmitting a Gaussian source over a (non-secure) Gaussian 
channel with side information is studied. |23l has introduced several hybrid digital-analog forms of the Costa and 
Wyner-Ziv coding ( |[24l ) schemes. In |[23l . the results of [25] is extended to the case that the transmitter or receiver 
has side information, and showed that there are infinitely many schemes for achieving the optimal distortion. 

In this paper, motivated by a covert communication system, we consider the problem of transmitting an i.i.d 
Gaussian source over an i.i.d Gaussian wiretap channel with side information available at the transmitter. We 
assume that the intended receiver has a certain minimum SNR and the eavesdropper has a strictly lower SNR 
compared to the intended receiver. We are interested in minimizing the distortion of source reconstruction at the 
intended receiver. We show that, here, unlike the Gaussian wiretap channel without side information, Shannon's 
source-channel separation coding scheme is not optimum in the sense of achieving the minimum distortion. We 
then propose three hybrid digital-analog secure joint source channel coding schemes which achieve the minimum 
distortion. Our first coding schemes are based on Costa's dirty paper coding scheme and wiretap channel coding 
scheme when the analog source is not explicitly quantized. We will illustrate that this scheme provide us an extra 
degree of freedom and therefore we can achieve the optimum distortion. Our second coding scheme is based on 
superposition of secure digital and hybrid digital-analog signals. We will show that for the problem of communicating 
a Gaussian source over a Gaussian wiretap channel with side information, there exists an infinite family of optimum 
secure joint source-channel coding scheme. We explicitly superimpose the quantized and analog signals in our third 
coding scheme. We will show that this scheme provide an infinite family of optimum secure joint source-channel 
channel coding schemes with a variable number of binning. Finally, we analyze our secure hybrid digital-analog 
schemes under the main channel SNR mismatch. We will show that our proposed schemes can give a graceful 
degradation of distortion with SNR under SNR mismatch, i.e., when the actual SNR is larger than the designed 
SNR. 

II. Preliminaries And Related Works 

A. Notation 

In this paper, random variables are denoted by capital letters (e.g. X) and their realizations are denoted by 
corresponding lower case letters (e.g. x). The finite alphabet of a random variable is denoted by a script letter (e.g. 
X) and its probability distribution is denoted by P(x). The vectors will be written as x n = (xi,X2, ...,x n ), where 
subscripted letters denote the components and superscripted letters denote the vector. The notation x\ denotes the 
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Fig. 1. Block digram of the secure joint source channel coding problem with Interference known only at the transmitter 

vector (xi,Xi + \, ...,Xj) for j > i. A Gaussian Random variable X with mean of m and variance of a 2 is denoted 
by X ~ J\f(m,a 2 ). The function E[.] represents statistical expectation. 

B. System Model And Problem Statement 

Source Model : Consider a memoryless Gaussian source of {1^}°^ with zero mean and variance a 2 . Thus, 
V~i ~ A/"(0, a 2 ) and assume that the sequence {Vi} is independent and identically distributed (i.i.d). We assume that 
the source is obtained from uniform sampling of a continuous-time Gaussian process with bandwidth W s (Hz). 
Furthermore, we assume that the sampling rate is 2W S samples per second. 

Channel Model : The source is transmitted over an Additive White Gaussian (AWGN) wiretap channel in the 
presence of an interference Si which is known to the transmitter but unknown to the receivers. The channel is 
modeled as follows: 

Y i = X i + S i + W i , (1) 
Z i = X i + S i + W-, 

where Xi, Yi and Zi are the channel input, the received signal by the intended receiver and the received signal by the 
eavesdropper, respectively. We assume that E[X 2 ] < P, and W{ ~ A/"(0, N±), W i ~ A/"(0, N 2 ). Furthermore, assume 
that S^s are a sequence of real i.i.d Gaussian random variables with zero mean and variance Q, i.e. Si ~ Af(0, Q). 
As the source, interference and the channel are i.i.d over the time, we will omit the index i through the rest of 
the paper. The channel is derived from a continuous-time AWGN wiretap channel with bandwidth W c {Hz). The 
equivalent discrete-time channel is used at a rate of 2W C channel uses per second. The block diagram of the system 
is depicted in Fig.l. 

Coding Scheme: The source samples are grouped into blocks os size m 

V m = (V 1 ,V 2 ,...,V m ), 

and the encoder is a mapping f m : M. m — » R n which satisfies the power constraint -E , [||/ m .(^ m )|| n ] < nP. Let us 
define the parameter p = n/m = W c /W s . In this paper we assume that p = 1. The received signals by the intended 
receiver and the eavesdropper are given by 

Y n = X n + S n + W n , (2) 

z n = x n + s n + w' n , 

where X n = f m {V m ), W n ~ A/"(0, iViI n ), W' n ~ M(0, N 2 I n ), and I n is the n x n identity matrix. The decoder 
at the intended receiver is a mapping g m : W l — > M m . The secrecy of the system is measured by the information 
leaked to the eavesdropper and is expressed as = ^I(V m ; Z n ). Note that I e = corresponds to perfect secrecy 
condition and implies that the eavesdropper obtains no information about the source. In this paper we consider 
the perfect secrecy situation. The average squared-error distortion of the coding scheme at the intended receiver is 
given by 

D ave , m (f m ,g m ,N x ,N 2 ) = -E[\\V m - V m \\\ (3) 
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where V m = g n (Y n ). For the purpose of analysis, we will consider sequences of codes (f n ,g n ), where m is 
increasing but the ration p = n/m is fixed. The asymptotic performance of the code is given by 

D ave (N u N 2 )= lim D ave , m (f m ,g m ,Ni,N 2 ). (4) 

Note that the above D ave is also a function of o~1 > 0, P > 0, Q > 0, and p > 0, but we assume that these 
parameters are known and fixed, and therefore express D ave as a function of (Ni,N 2 ). In subsequent sections, we 
refer to D ave as mean-squared distortion and omit the superscript "ave" and denote it by D, i.e., D = D ave . 

Distortion Exponent: In practical scenarios, the transmitter usually does not have an exact knowledge of A?i but 
knows that Ni < N d , where N d is the noise variance corresponding to the design SNR d = j^. The eavesdropper 
channel is still a degraded version of the main channel and is assumed to have the lowest SNR 2 < SNRd < SNRi, 
where SNR 2 = and SNRi = The receiver is assumed to have a perfect estimate of SNRi, but the 
transmitter communicates at a lower designed SNRd- In this scenario, we expect a graceful degradation of distortion 
D(SNRi) with SNRi compared with D(SNR d ) when the actual SNRi > SNR d . Let define the distortion 
exponent as follows: 

Definition 1: For a fixed SNR 2 , the distortion exponent of D(SNRi) is given by 

A_ log D(SNRi) 

SNR^oo log SNRi 

The highest possible distortion exponent is p and therefore, < C < P- The distortion exponent can be used as 
a criterion for the robustness of a coding scheme. A high distortion exponent means that the coding scheme is 
more robust. In this paper, we propose different robust coding schemes which achieve the optimum mean-squared 
distortion. Before introducing our proposed schemes, we need to review some related works in this area. 



C. Related Works 

1) Digital Wiretap Channel: In a digital wiretap channel (without any interference S), a digital message 
M € {1, 2, nC s } is transmitted to the intended receiver while the eavesdropper is kept ignorant. Wyner in 
characterized the secrecy capacity of this channel when the eavesdropper's channel is degraded with respect to 
the main channel. Csiszar et. al. in [3] considered the general wiretap channel and established its secrecy capacity. 
Let us assume X, Y and Z be the channel input, intended receiver's signal and eavesdropper's signal, respectively. 
The secrecy capacity of a wiretap channel is given by 

C S = 2W C [I(U;Y)-I(U;Z)}, (6) 

where U — > X — > YZ forms a Markov chain. When the channels are AWGN, |[TT1l showed that the secrecy capacity 
is given by 

T P P 

C, 11, 



log(l + — ) - log(l + — ) 



(V) 



Here, we briefly explain the coding scheme. We Generate 2 nI ( U ' Y ^ Gaussian codewords U n and through them 
uniformly at random into 2 nCs bins. Each bin thus contains 2 nI ( U]Z ^ codeword U n . To encode the message M 6 
{1, 2, 2 Cs } We randomly choose a U n from the bin which is indicated by M and send it. The intended receiver 
seeks for a U n which is jointly typical with Y n and declare the bin index as the transmitted message. The 
probability of error asymptotically tends to zero, i.e., lim ra _ s . 0O P e (M ^ M) — > 0. The information leakage is 
lim n _ +oo ij(Af;Z n ) = 

2) Digital Dirty-Paper Coding: Consider transmitting a quantized (digital) source over a point-to-point AWGN 
channel (without any eavesdropper) with side information known at the transmitter. The received signal in this 
model can therefore be written as Y = X + S + W. Costa in [12J showed that the capacity of this channel is given 

C = ^ c log(l + — ), (8) 

iVi 

which is equal to the capacity of an AWGN channel without the interferer S. The achievability scheme- which is 
called Dirty-Paper Coding (DPC)- is as follows: Let 

R = 2W C [I(U;Y)-I(U;S)}, (9) 
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where U — > X — > Y forms a Markov chain. We generate 2 nI ^ U;Y ^ Gaussian codewords U n and through them into 
2 nR bins. In each bin there exists 2 nI<yU ' ,s ^ codewords. To transmit a message M G {l,2,...,2 nR }, we choose a 
U n in the bin which is indicated by the message M, such that (U n , S n ) are jointly typical. The channel input X 
is generated as a function of U and S as follows: 

U = X + aS, (10) 

where X ~ J\f(0,P) is independent of S and a = P + Ni ■ The decoder seeks for a U n which is jointly typical 
with Y n and declare the bin number as the transmitted message. The channel output i&Y = X + S + W = 
U + (1 — a)S + W and it is easy to show that with a = P + Ni , the achievable rate R = C. 

3) Digital Secret Dirty-Paper Coding: Consider transmitting a digital source over a Gaussian wiretap channel 
in the presence of the interference S known only at the transmitter. The received signals by the intended user and 
eavesdropper are given by 

Y = X + S + W, (11) 

z = x + s + w', 

Even in a Gaussian case, the secrecy capacity of this problem is still unknown. We can get an achievable rate by 
combining the secrecy coding of wiretap channel with Costa's Dirty-Paper-Coding. We refer to this coding scheme 
as Digital Secret-Dirty-Paper-Coding (DS-DPC). The following theorem characterizes the best known achievable 
secure rate for the Gaussian wiretap channel with side information using DS-DPC scheme: 

Theorem 1: ( O, ifTOl ) For the Gaussian wiretap channel with side information, an achievable secrecy rate is 
given by 

R s = 2 Wc max min{ J(C/ a ;F) - I(U a ;S),I(U a ;Y) - I(U a ;Z)}, (12) 

a 

where < a < 1 is a real number, U a = X + aS, and X ~ M(0, P). 

The above optimization is further analyzed in (9J, IfTOl to provide the more explicit expression for the secrecy rate. 
Let 

R(a) = I(U a ;Y)-I(U a ;S), (13) 

and 

R z {a) = I(U a ;Y)-I(U a ;Z). (14) 
p 



The function R(a) is maximized at a* = P + Ni and 

2 "° y ' n x j 



R(a*) = I- log + (15) 



The function Rz(a) is maximized at a = 1 and 

2"° v p + q + N 2 m 



R z (l) = - log ~ AT — . (16) 



It is easy to show that R(ao) = Rz(ao), where 



Q(P + N 2 ) 

Let 



PQ + PVQ (P + Q + N 2 ) 
a o = , , M ■ (17) 



^_ Nl _Q + y@m*Em as) 

Q VQi + 4QN 2 
Ph = ~2 + 2 ' 



then the secrecy rate of (fT2l can be written as 

R(a*), if P<P L ; 



Rs 



R(a ), if Pl<P< Ph; (19) 
R z (l), if P>P H - 
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The above three cases correspond to the three possible cases of the optimization problem of max a mm{R(a), Rz(a)}: 
(1) R(a) is optimized at a = a*, and R(a*) < Rz{a*); (2) Rz{a) is optimized at a = 1, and > Rz{^)', 
and (3) R{a) is optimized subject to R(a) = Rz(a). 

It can be seen from the above equation that the Gaussian wiretap channel with side information has larger secrecy 
capacity than the Gaussian wiretap channel without the interferer. The side information therefore helps to improve 
the secrecy capacity. This is in contrast to the point-to-point channel without the secrecy constraint, in which the 
side information does not affect the capacity. 

As showed in ifTOl , the achievable secrecy rate given in ( fT9l ) is indeed the secrecy capacity for the cases 
when P < Pl and when P > Pjf. The secrecy rate in the former case is the capacity of the channel without 
secrecy constraint and with the transmitter knowing the state sequence (Dirty-Paper Channel). The secrecy rate in 
the latter case is the secrecy capacity of an enhanced wire-tap channel, in which the state variable is used as the 
channel input instead of the channel interference. Both of these two secrecy capacities are clearly upper bounds 
on the secrecy capacity for the original wiretap channel with side information. Hence, achieving these two bounds 
imply achieving the secrecy capacity. 



III. Separation Based Scheme 

Let us consider our problem of transmitting a Gaussian source over the Gaussian wiretap channel with side 
information as depicted in Fig.l. In this model no leakage information rate is allowed for the eavesdropper. As 
assumed in this paper p = n/m = 1. In this section, we characterize the achievable distortion when the source 
V n is first quantized using an optimum quantizer to produce an index m € {1,2, ...,2 nRa , where R s is given in 
(fT9l ). Then, the index m is transmitted using secret dirty paper coding scheme. As the quantizer output is digital 
information, we refer to this scheme as digital secret dirty paper coding. We briefly review this scheme here. 
Let U a = X + aS, we first generate 2 nI ( Ua '< Y ^ i.i.d Gaussian sequences U™ and randomly distribute them into 
2 nR B bins such that each bin contains 2 nmax W<*> s ^ I{u "> z ^ . We index each by m € {1, 2, 2 nR ° }. Then place 
the 2 nm ^ I( - u "' S ^ I( - u -' Z ^ codewords in each bin randomly into 2 nm ^W u «' S ^ I( - u ^ z ^- nI( - u «' Z ^ subbins. To send 
message m with an interference S n , the encoder looks in bin m for sequences U™ such that (U™,S n ) is jointly 
typical. The encoder then randomly choose one of the U% and transmits the associated X n = U™ — aS n . The 
legitimate receiver seeks for a unique sequence U£ such that (Y n , U™) is jointly typical and declares the index of 
the bin containing U™ as the transmitted message. 

Since the transmission rate is R = R s , the distortion in V n is given by the distortion rate function of D(R). For 
a Gaussian source and mean-squared error distortion D{R) = a 2 2~ 2R and therefore, the overall distortion is given 
by 



D = <rl x I 



Ni 



if p<p l ; 



(P+^Q)(P+Q+jV 1 )-(P+a Q) 2 - f p < p < p om 
P(P+Q+N!) ' 11 rL - r - ^H, K^V) 

P+Q + N 2 N ± if P > Prr 

, P+Q+iViAr 2 ' 11 r ^ r H- 

Note that the above distortion value for P > Ph is still greater than the optimum value, i.e., D opt = a^2~ 2Ir pjp^ ■ 
Therefore, while for P > Ph, the channel coding scheme achieves the secrecy capacity, however, the separation 
abased scheme to transmit a Gaussian source is not optimum. The following theorem illustrates this observation. 

Theorem 2: For transmitting a Gaussian source over a Gaussian wiretap channel with side information knowing 
at the transmitter, the separation based scheme is not optimum, unless for P < Pl- 

In the following section we show that there exist a few secure joint source channel coding schemes, which are 
optimum for all range of P. Beside achieving the optimum distortion, we will show that our propose secure joint 
source channel coding are robust when there is an SNR\ mismatch. We will analyze the robustness of these scheme 
later on. 



IV. Secure Hybrid Digital-Analog Dirty Paper Coding 

A. Scheme I 

In this section we propose a secure joint source channel coding scheme where the analog source V n is not 
explicitly quantized. The code construction, encoding and decoding procedures are as follows. 
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Let us define an auxiliary Gaussian random variable U a k as follows: 

U a>k = X + aS + kV, (21) 

where X ~ N(0,P), and X, 5 and are pairwise independent. 

Codebook generation: We generate 2 n ( I ( Ua . k '< Y ) +I >) i.i.d sequences U™ k , where each component of each sequence 
is Gaussian with zero mean and variance P + a 2 Q + ka 2 . Then, we distribute these codewords into 2 nR bins, 
where R > 0. 

Encoding: Given the interference sequence S n and the source sequence V n , the encoder find U™ k 's such that 
(U™ k , S n , V n ) are jointly typical. The encoder then randomly chooses one of them and transmits X n = U n — 
aS n — kV n . If such U n, s cannot be found, the encoder declares failure. Let P e \ be the probability of an encoder 
failure. 

From the extensions of typicality to infinite alphabet case ||26l , we have lim n ^. 0O P el — > provided that 

I(U ajk ; Y)-R> m^{I(U aX , Z),I(U Q y, SV)} , (22) 
for any R > 0. Therefore the following condition must be satisfied: 

I(U a , k ;Y) > m a x{I(U aX ,Z),I(U a y,SV)}. (23) 
Decoding: The legitimate receiver, looks for a unique U™ k such that {U™ k ,Y n ) is jointly typical and declare 



U™ k as the decoder output. It is easy to show that if the condition of (1231) is satisfied the probability that the 
decoder output is not equal to the encoded U™ k goes to zero when n — > oo. The legitimate receiver then estimate 
the source V n by using the pair (U™ k ,Y n ) as follows: 

V n = \ x Y n + X 2 U^ k , (24) 

where Ai and A2 are such that minimizes the distortion D = E[\\V — V\\ 2 ]. After some algebra we can see that 
the optimum values for (Ai,A2) are given by 

\ = -kal{P + aQ) 

1 fcV2(P + Q + Ar 1 ) + (l-a) 2 PQ + ATi(P + a 2 Q)' ^ ; 
\ = kaljP + Q + N,) 

2 k 2 al{P + Q + N 1 ) + {l-afPQ + N l {P + a 2 QY K ' 

The MMSE estimation therefore leads to the following distortion: 

2 

D(a,k)= a \ (27) 
1 + =_2k 

A 4 

where \i is given by 

(l-afPQ + N^P + gZQ) 
" = P + Q + Nl • (28) 

We need to find the optimum values of (a, k) which minimizes the distortion D with the constraint of d23l . we 
choose (a,k) such that I(U ajk ;Y) > I(U a ^\SV) > I(U ajk ;Z). This constraint guarantees that the eavesdropper 
cannot decode U ak . Our optimization problem can therefor be written as 

min D(a,k) (29) 
(a,k) 

s.t: I(U a>k ;Y) > I{U aik ;SV) > I(U a , k ;Z). 

After some manipulation, it is easy to see that the valid region of (a, k) is as follows (see Fig.2. for a typical 
valid region): 

k 2 a 2 v {P + Q + N 2 )> -Q(P + N 2 )a 2 + 2PQa + P 2 , 
k 2 a 2 (P + Q + < -{l-a) 2 PQ-N 1 {P + a 2 Q) + P(P + Q + N 1 ) 
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Fig. 2. A typical valid region for choosing (a, k) in scheme I 



In this region the optimum values of (a, k) and the related D(a, k) are given by 

P 



(30) 




(31) 



(32) 



The achievable distortion D is indeed optimum and is equal to the distortion of a Gaussian AWGN with side 
information and without the secrecy constraint. Note that in this scheme, unlike the separation based scheme, we 
can choose the above optimum (a, k) for all range of P. The parameter K (which is due to the analog source), 
here, provides an extra degree of freedom. Therefore, we can choose the optimum values of (a, k) such that the 
constraint of I(U a y,Y) > I(U a y, SV) > I(U a ,k]Z) be satisfied for all P. 

Note that the proposed secure hybrid digital-analog dirty paper coding is not entirely analog in the sense that 
the auxiliary random variable U a ^ is from a discrete codebook. In contrast to secure digital dirty paper coding 
however the source is not explicitly quantized and is embedded into the transmitted signal X in an analog method. 
An other feature of the secure analog dirty paper coding is that there is no need to double binning the codewords. 
In the digital scheme however double binning is necessary which one binning is for dirty paper coding and the 
other binning is for secrecy. 



In this scheme, we choose the transmitted signal X n as a superposition of two signals X™ and XP, which are the 
outputs of secure digital and hybrid digital-analog dirty paper encoders, respectively. Fig.3. illustrates this scheme. 

We first quantize the source at a rate R < R s , where R s is given in ( fT9l ). Let the quantizer error be E n = V n —V* n , 
where V* n is the reconstruction of V n . The quantization error has a variance of a\ = a^2~ 2R . We encode the 
quantized digital part using a secure digital dirty paper encoder which treats S n as the interference. The output 
signal of this section is denoted by X™ which has a power of Pi. The second part of the encoder is same as 
scheme I, which treats S n and X™ as interference. The output of this part is denoted by X%, which has a power 
of Ph = P — Pi. The transmitted signal is the superposition of Xf and X%, i.e., X n = Xf + Xfi. 

We choose the auxiliary random variable of the digital encoder as U\ = X\ + a\S, where X\ independent of 



B. Scheme II 
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Fig. 3. Encoder model for secure superposition coding, where DS-DPC is discrete secure dirty paper coding and SHDA I is the hybrid 
scheme I 



S. The power Pi and a\ of this encoder are chosen as follows: 



Pi = (P + N 1 )(l-2- 2R ), (33) 
Pi 

01 P 1 + P h + Nl - 

Note that Pi > and the above choice for a\ corresponds to treating as noise in addition the channel noise 
W. 

In the second encoder, we encode the quantization error E n using the coding scheme I. We choose the parameters 
of this scheme as follows: 

P h = (P + N^- 2 * - N!, (34) 
Ph 



ah~- 



k z = 



Pi 



2_ 1 h 



^(Ph + my 

Note that as R < ^ log , the power Ph is always positive. The auxiliary random is chosen as U a ^ = 
Xh + Cih{X\ + S) + kE, where X\ + S considered as the net interference. Thus, we choose independent of 
X 1 , S and E. 

The decoder, first decode the quantization index according the decoding rule of the secure digital dirty paper 
coding scheme. After that it reconstructs V* n . Then, it estimate the quantization error E n according the decoding 
rule of Scheme I. The overall distortion is the distortion in estimating E n . According to the analysis of Scheme I, 
the overall distortion is given by 

2 

D= — (35) 



P+N, 



As we can see, for any coding rate R of the first encoder such that R < R s , this scheme is valid and leads to 
the optimal distortion. Therefore, we have the following theorem. 

Theorem 3: For the problem of transmitting a Gaussian source over a Gaussian wiretap channel with side 
information knowing at the transmitter, there exists an infinite family of optimum secure joint source channel 
coding scheme. 

C. Scheme HI 

This scheme is a combination of the scheme I and scheme II. In this scheme the quantized signal and the analog 
part are explicitly superimposed. 
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First, we quantize the source V n by using an optimal quantizer at rate R < R s . Let V* n and E n be the digital 
reconstruction of V n , and the quantization error vector, respectively. According to the Rate-Distortion theorem, the 
quantization error E n is a i.i.d Gaussian vector. 

We next define an auxiliary random variable U a ^ as follows: 

U a<k = X + aS + kE, (36) 

where, X ~ M(0,P), E ~ A/"(0, a 2 2~ 2R ), and X, S and E are independent of each other. The coding/decoding 
procedure is as follows: 

Codebook Generation : We generate 2 nI ( Ua ■ k ' Y \ i.i.d Gaussian sequences where each component has zero mean 
and variance of P + a 2 Q + k 2 a 2 2~ 2R . Then we distribute these codewords into 2 nR bins and this is shared between 
the encoder and the decoder. The rate R must be chosen such that each bin contains 

N b = 2 nmax { / ( c/ =. fc ; s ' £; )> / ( i7 °- fc ' z )} (37) 
codewords. We then randomly distribute the iVj codewords of each bin into N s b subbins, where N s b is given by 

N sb = 2 nmax { / ( a °^ S£ )' 7 (^; z )}- n7 ( c/ °.*; z ). (38) 

Encoding: Let m € {1, 2, 2 nR } be the quantization index corresponding to the quantized vector V* n . To send 
the message m with an interference S n , the encoder looks for U™ k sequences in the bin m such that (U£ k , S n , E n ) 
are jointly typical with respect to the distribution of (l36l) . If such k cannot be found, encoder declares a failure. 
Let P e i be the probability of encoding failure. The encoder then randomly choose of the U™ k and transmits 

X n = XJl k - aS n - kE n . 

Decoding: The received signal by the legitimate receiver is Y n = X n + 5 n + W n . The legitimate receiver looks 
for a unique U™ k such that is jointly typical with Y n . If such a unique U n can be found, the decoder declares U n 
as the decoder output, otherwise, it declares a failure. Let P e 2 be the probability of the decoding failure. Then, the 
legitimate receiver estimates E n from U n and Y n . 

We can see by similar Gelfand-Pinsker coding argument and Wiretap coding argument that if 

< R < I(U a , k ; Y) - max{/([/ a>fc ; SE), I(U a>k ; Z)}, (39) 

then, P e i and P e 2 goes to zero when n — > oo. 

Estimation : The legitimate receiver makes an MMSE estimate of V n from the observations of [V* n , U™ k , Y n ], 
where 

V= V* + E, (40) 
Ua tk = X + aS + kE, 
Y= X + S + W. 

Let o"g = o 2 2~ 2R . The optimum linear MMSE estimation is given by 

V = XiV* + \ 2 U a , k + X 3 Y, (41) 

where [Ai,A2,As] are chosen such that minimizes the distortion D = E[\\V — V\\ 2 ]. We choose the parameters 
(a, k) as follows: 

P 

a = , (42) 

P + Ni' K ' 

2 P + Ni-Ni2 2R 

a 2 (P + Ni) ■ 

We can see the the above choice for (a, k) satisfies the condition of d39l ). Let A be the covariance matrix of 
(V* n ,U™ k ,Y n ) T and let T be the correlation vector between V and (V* n , U™ k , Y n ) T . The matrices of A and T 
then are given by 

a 2 -a 2 

P + a 2 Q + k 2 a 2 P + aQ | (43) 
P + aQ P + Q + Ni 
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and 



T = (a 2 v - a 2 e Ml$) T (44) 

The coefficients of the linear MMSE estimation are given by (Ai,A 2 ,A 3 ) r = A -1 r and the minimum distortion 
is given by 

D = a 2 v - r T A _1 r (45) 



P±Ni 

Note that this scheme is an intermediate scheme between the secure digital dirty paper coding wit the maximum 
possible binning and the hybrid digital-analog scheme I with the minimum possible bining. We can therefore have 
a family of schemes with varying bins by changing R such that the condition of d39l ) is satisfied. 

Theorem 4: For the problem of transmitting a Gaussian source over a Gaussian wiretap channel with side 
information knowing at the transmitter, there exists an infinite family of optimum secure joint source channel 
coding scheme with a variable number of binning. 

Note that the scheme III is closely related to the secure digital dirty paper coding and the scheme II. The 
difference however is that in the scheme III, the transmitted signal is not a superposition of the two signals as seen 
in the scheme II. 



V. Performance Analysis Of The Schemes With SNR Mismatch 

In this section, we analyze the performance of the proposed secure joint source channel coding schemes in the 
presence of SNRi mismatch. Here, we assume that we have designed the schemes to be optimum for a designed 
channel SNRd, but the actual SNRi is such that SNR2 < SNRd < SNRi. Separation based digital schemes 
suffer from the threshold effect. When the actual channel SNRi is worse than the designed SNRd, the index cannot 
be decoded and therefore the distortion drastically increases. When the actual channel SNRi is better than the 
designed SNRd, the distortion is limited by the quantization and does not improve. Thus, the distortion exponent 
of the separation based scheme is £ = 0. Our proposed secure hybrid digital-analog schemes however offer better 
performance in the presence of SNRi mismatch. 

A. Performance Analysis of Scheme I 

Let consider the proposed scheme I, which is designed for a SNRd while actual signal-to-noise ratio is SNRi > 
SNRd > SNR2. The receiver can estimate the actual noise power Ni. Since the receiver knows that the system 
is designed for SNRd, the receiver estimates V as follows: 

V = Xi d Y + X 2d U, (46) 

where A^ and X 2d are given in (|25T ) and (|26l ), respectively when (a, k) are set as follows: 



d aUP + NdY 

The received signal is Y = X + S + W, where W ~ A^(0, N%). The actual U is set by the transmitter as follows: 

U = X + a d S + k d V, (48) 

The actual distortion is therefore given by 

D (SNR ) = (9 N l + {p(p + Q) + 2PN * + N i) gi) (49) 

a{ ' P 2 (P + Q) + P(P + Q)Nd + QN^ + (P(2P + Q) + 3PN d + Nj)Ni' 

A useful measure for robustness of a single coding scheme is the rate of decay of the distortion as a function of the 
actual SNRi when SNRi — > 00 (see the equation ©). An upper-bound on the achievable ( can be obtained by 
assuming that a genie informs the transmitter of the actual SNRi and the transmitter chooses an optimum encoding 
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scheme based on the actual SNRi. The distortion for the genie-aided scheme is D = x+snR! ■ Thus, the distortion 
exponent is £ = 1. Note that in the absence of any side information the distortion exponent of the genie-aided 
scheme is £ = 1. In the the absence of the eavesdropper also, the distortion exponent is ( = 1. Therefore, for any 
single encoding scheme £ < 1. 

From equation ©, the distortion exponent is given by 

log D a (SNRx) 
SNR^oc log SNRx 

1) Absence of Interference: When there is no interference at the transmitter, i.e., Q = 0. We can see from 
the equations (l49b and (f5Qb that ( = 1. Therefore, scheme I achieves the optimum distortion D opt as well as the 
optimum distortion exponent £ = 1. 

2) Presence of Interference: In the presence of interference, i.e., Q ^ 0, we can see that £ = 0. This is because 
some residual interference exists in the received signal Y, and therefore in hight SNRx, the distortion exponent 
is dominated by this residual interference. However, if optimal distortion is not desired at SNRx, then we can 
achieve the optimum distortion exponent of £ = 1 by using a minor modification in the scheme I. Let modify the 
auxiliary random variable U in the scheme I as follows: 

U = X + S + k'V. (51) 

In this modified scheme a is chosen to be 1, which is not an optimum choice for SNR d . According to the valid 
region of Fig.2, the value of K' must be such that 



l pl+PQ-QN 2 , l p2 + P Q-Q Nl 
al{P + Q + N 2 ) < < V CJ 2 ( p + Q + A r 1 )- 



Hence, k' can be chosen to be arbitrary close to w ^jp^^^j- Now X is transmitted and the received signal 
by the legitimate receiver is Y. Using an MMSE estimate for V, the final distortion for a actual SNRx when the 
system is designed for SNR d is given by 

Da(SNRl) ~ (P + Q)N 1 + k^(P + Q + N 1 y (53) 



where, k' d = J ^pj^j^j ■ Hence, for SNR\ — > oo, the distortion exponent is ( = 1. Fig. 4. shows the distortion 
of different schemes versus SNRx. In this figure P = 1, Q = 2, SNR d = 2MB, N 2 = 1, a% = 1, and quantization 
rate is R = 1. 



B. Performance Analysis of Scheme II 

Let consider the proposed scheme II, in this section. Again, we assume that the scheme is designed for SNRd, 
but the actual is SNRx > SNj > SNR 2 . Scheme II consists of two parts, namely secure digital part and secure 
hybrid digital-analog part. The performance of the digital part remains constant by increasing the SNRx. Thus, 
performance analysis of this scheme is exactly same as scheme I, when we replace a% and P with a\ = al2~ 2R 
and (P + N d )2~ 2R - N d , respectively. 

C. Performance Analysis of Scheme III 

Next, we analyze the performance of the secure hybrid digital-analog of scheme III under the main channel 
mismatch. The different random variables of this scheme are given below. 

U d = X + a d S + k d E, (54) 

Y = X + S + W, 

V = V* + E, 

where a d = P + Nd , k\ = P ^-p7pqj^j— ■ The receiver make an MMSE estimate for V as follows: 

V = (\ ld ,\2dA3d)(V\U d ,Y) T , (55) 
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Separation Based Scheme 




Fig. 4. Distortion Vs SNRi for different schemes. Here, P = 1, Q = 2, SNR d = 20dB, N 2 = l,al = 1, and i2 = 1. 



where (Aid, ^2d, A3^) T = 1 Td, and and Td are given in (l43l) and (l44l ). respectively when (a, fc) are replaced 
with (ad,kd). The actual distortion for the legitimate receiver can therefore written as follows: 

D a (SNRi) = a 2 v - r^A" 1 ^ (56) 

After some math, the actual distortion is given by 

a{ 1} (P + N d y{P + Q + Ni)- 2™(N d - N X )P(P + Q + N d ) ' {D ) 

Note that here the actual distortion depends on the quantization rate R and for a special case of R = 0, the above 
equation is equivalent to the equation of (l49l ). Similar to the performance analysis of scheme I, we can see that 
when Q = 0, this scheme achieves the optimum distortion exponent of £ = 1. When Q ^ 0, the distortion exponent 
is £ = 0. However, if the optimum distortion at SNR± is not required, we can modify the scheme III by choosing 
a = 1 to achieve the optimum distortion exponent ( = 1. As the analysis for this case is straightforward and similar 
to analysis of scheme I, we therefore omit it here. 



VI. Conclusion 

In this work we considered secure joint source channel coding schemes for transmitting an analog source over a 
Gaussian wiretap channel with known interference at the transmitter. We showed that the separation based coding 
scheme cannot achieve the minimum distortion. We then proposed a few class of schemes which achieved the 
optimum distortion. Our proposed schemes are based on Costa's dirty paper coding scheme and Wyner's wiretap 
channel coding in which the analog source or analog quantization error is not explicitly quantized and embedded 
in the transmitted signal. We analyzed the performance of the proposed schemes under SNR mismatch. We showed 
that the proposed schemes can obtain a graceful degradation of distortion with SNR under perfect secrecy constant. 
The cost of achieving optimum distortion exponent and perfect secrecy, is to design the system near optimum 
distortion for a designed SNR. A possible future problem can be if it is still possible to get the optimum distortion 
exponent under perfect secrecy constraint when we enforce to get optimum distortion for a design SNR. Another 
possible future work is to design the secure joint source-channel coding schemes for the source-channel bandwidth 
mismatch (p ^ 1). 
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